Pulse-stream binary stochastic hardware for neural computation : the Helmholtz Machine
نویسنده
چکیده
................................................................................V DECLARATION OF ORIGINALITY ........................................... VII ACKNOWLEDGEMENTS........................................................... IX TABLE OF CONTENTS.............................................................. XI TABLE OF FIGURES...............................................................XVII LIST OF TABLES ...................................................................XXIII TABLE OF ACRONYMS.......................................................... XXV CHAPTER
منابع مشابه
Pulse-Based Circuits and Methods for Probabilistic Neural Computation
This work argues that it should be possible to combine pulse-based VLSI techniques with the relatively simple training rules of the Helmholtz Machine stochastic neural architecture, in order to build an analogue probabilistic hardware model of the latter. An overview of the necessary components is presented, as well as a design for a pulsewidth modulation oscillator, capable of transforming a c...
متن کاملRecurrent Sampling Models for the Helmholtz Machine
Many recent analysis-by-synthesis density estimation models of cortical learning and processing have made the crucial simplifying assumption that units within a single layer are mutually independent given the states of units in the layer below or the layer above. In this article, we suggest using either a Markov random field or an alternative stochastic sampling architecture to capture explicit...
متن کاملA Performance Analysis of Pulse Stream Neural and Fuzzy Computing Systems
| This paper presents an annotated overview of existing hardware implementations of Arti cial Neural Systems based on \Pulse Stream" modulations. Pulse Streams are quasi-periodic binary waveforms which convey analog information on waveform timing. The theoretical bases of Pulse Stream computation are shown for the major techniques, and basic circuits are described for most Neural and Fuzzy func...
متن کاملTheoretical and Implementation Aspects of Pulse Streams: an Overview
This tutorial paper presents an annotated overview of existing hardware implementations of Artificial Neural Systems based on “Pulse Stream” modulations. Pulse Streams are quasi-periodic binary waveforms which convey analog information on waveform timing. The theoretical bases of Pulse Stream computation are shown for the major techniques, and basic circuits are briefly described for most Neura...
متن کاملImproved representations and hardware implementation of the Helmholtz Machine
Probabilistic computing forms a relatively new computational style, of significant practical interest because stochastic behaviour is common and must be taken into accountin in biological and other real-world processes. We examine a particular stochastic ANN architecture, the Helmholtz Machine, investigating its characteristics, with particular respect to its wake-sleep training algorithm, and ...
متن کامل